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Mathematical  morphology  provides  the  operations  of  dilation,  erosion,  opening  and 
closing  for  performing  non-linear  image  analysis  for  binary  or  grayscale  images.  The  algebra 
of  mathematical  morphology  is  as  rich  as  the  algebra  of  convolution  and  correlation.  The 
algebra  is  nit  based  on  linear  combination  and  has  no  relation  to  spatial  frequencies.  Rather, 
it  has  an  intrinsic  connection  to  shape  due  to  the  primitive  matching  property  inherent  in 
the  opening  and  closing  morphological  operations. 

Mathematical  morphology  can  be  an  important  component  of  many  of  the  future  smart 
seniors  the  Army  is  developing.  The  technology  of  mathematical  morphology  has  proved 
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itself  in  the  manufacturing  industry  where  it  is  being  successfully  used  on  the  factory  floor 
for  visual  robot  guidance,  object  recognition,  inspection,  and  flaw  detection.  Almost  every 
company  manufacturing  pixel  pushing  machine  vision  boards  has  one  board  capable  of 
performing  mathematical  morphology  as  well  as  the  traditional  convolution  operations. 

It  is  now  time  for  the  Army  to  benefit  from  what  morphology  work  has  already  been  done 
and  to  develop  a  program  of  what  needs  to  be  done.  The  purpose  of  the  morphology  workshop 
was  to  review  some  of  the  basic  and  existing  theory  of  morphology,  illustrate  how  morphology 
performs  recognition  shape  extraction,  present  new  results  in  mathematical  morphology,  and 
make  recommendations  to  the  Army  about  new  research  areas  in  morphology  which  need  to 
be  developed  in  order  to  benefit  Army  programs.  The  workshop  involved  invited  speakers 
who  ar  known  for  the  work  they  have  published  or  done  in  mathematical  morphology. 
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1.  Summary 

V  Mathematical  morphology  provides  the  operations  of  dilation,  erosion,  opening  and 
closing  for  performing  non-linear  image  analysis  for  binary  or  grayscale  images.  The  algebra 
of  mathematical  morphology  is  as  rich  as  the 'algebra  of  convolution  and  correlation.  The 
algebra  is  not  based  on  linear  combination  and  has  no  relation  to  spatial  frequencies.  Rather, 
it  has  an  intrinsic  connection  to  shape  due  to  the  primitive  matching  property  inherent  in 
the  opening  and  closing  morphological  operations. 

Mathematical  morphology  can  be  an  important  component  of  many  of  the  future  smart 
sensors  the  Army  is  developing.  The  technology  of  mathematical  morphology  has  proved 
itself  in  the  manufacturing  industry  where  it  is  being  successfully  used  on  the  factory  floor 
for  visual  robot  guidance,  object  recognition,  inspection,  and  flaw  detection.  Almost  every 
company  manufacturing  pixel  pushing  machine  vision  boards  has  one  board  capable  of 
performing  mathematical  morphology  as  well  as  the  traditional  convolution  operations.  >  v,  fC 

It  is  now  time  for  the  Army  to  benefit  from  what  morphology  work  has  already  been  done 
and  to  develop  a  program  of  what  needs  to  be  done.  The  purpose  of  the  morphology  workshop  ^ 
was  to  review  some  of  the  basic  and  existing  theory  of  morphology,  illustrate  how  morphology 
performs  recognition  shape  extraction,  present  new  results  in  mathematical  morphology,  and 
make  recommendations  to  the  Army  about  new  research  areas  in  morphology  which  need  to 
be  developed  in  order  to  benefit  Army  programs.  The  workshop  involved  invited  speakers 
who  are  known  for  the  work  they  have  published  or  done  in  mathematical  morphology. 


2.  Workshop  Overview 

The  two-day  workshop  was  held  under  the  auspices  of  MICOM  at  the  Tom  Bevill  Center 
of  the  University  of  Alabama,  Huntsville,  on  25  and  26  July  1988.  The  invited  presenters 
were 


Dr.  Robert  M.  Haralick 
University  of  Washington 

Dr.  Stephen  S.  Wilson 
Applied  Intelligent  Systems,  Inc. 

Dr.  Petros  Maragos 
Harvard  University 

Dr.  Ronald  W.  Schafer 

r* _ o’- -i. 


Seventeen  people  attended  the  workshop. 


3.  Workshop  Program 


08:00-09:30 

09:30-10:30 

10:30-10:45 

10:45-11:45 

11:45-13:00 

13:00-14:30 

14:30-15:45 

15:45-16:00 

16:00-17:00 


08:00-09:00 

09:00-09:30 

09:30-10:30 

10:30-10:45 

10:45-11:15 


11:15-11:30 


Program 
25  July  1988 

Image  Analysis  Using  Morphology:  The  Concepts.  Robert  M.  Haralick 
Applications  of  Morphology  in  Industry:  Part  I.  Steve  Wilson 
Coffee  Break 

Applications  of  Morphology  in  Industry:  Part  II,  Steve  Wilson 
Lunch 

Image  Analysis  Using  Morphology:  The  Algebra.  Robert  M.  Haralick 
Army  Needs  and  Morphology:  Panel  Session  I 
Coffee  Break 

Morphological  Signal  Processing  Systems:  Part  I,  Ron  Schafer 

Program 
26  July  1988 

Mathematical  Morphology  Applied  to  Multi-Scale  Image 
Representation  and  Shape  Description.  Petros  '  ragos 

Morphological  Signal  Processing  Systems:  Part  II,  Ron  Schafer 

Army  Needs  and  Morphology:  Panel  Session  II 

Coffee  Break 

Mathematical  Morphology  Applied  to  Multi-Scale  Image 
Representation  and  Shape  Description:  Part  II.  Petros  Maragos 

Closing  Remarks 


4.  Abstracts  of  Talks 


Image  Analysis  Using  Mathematical  Morphology 

Robert  M.  Ha.ra.lick 
Intelligent  Systems  Laboratory 
Department  of  Electrical  Engineering  •  FT-IO 
University  of  Washington 
Seattle.  WA  98195 


ABSTRACT 

For  the  purposes  of  object  or  defect  identification  required  in  industrial 
vision  applications,  the  operations  of  mathematical  morphology  are  more 
useful  than  the  convolution  operations  employed  in  signal  processing  because 
the  morphological  operators  relate  directly  to  shape.  This  talk  reviews  both 
binary  morphology  and  grayscale  morphology,  covering  the  operations  of 
dilation,  erosion,  opening  and  closing,  their  relations  and  the  morphological 
sampling  theorem.  Examples  are  given  for  each  morphological  concept  and 
explanations  are  given  for  many  of  their  inter-relationships.  A  comparison 
between  the  algebra  of  morphology  and  the  algebra  of  convolution  reveals 
some  important  similarities  which  are  suggestive  of  the  underlying  depth  and 
richness  of  the  non-linear  algebra  of  morphology. 


Applications  of  Morphology  in  Industry 


& 
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Steve  Wilson 

Applied  Intelligent  Systems.  Inc. 
Ann  Arbor,  MI  48103 


ABSTRACT 


Morphology  has  been  successfully  used  in  a  number  of  applications  in 
industrial  machine  vision.  This  session  will  outline  vision  principles  involved  in 
the  application  of  morphology  to  several  different  real  world  image  processing 
problems  such  as  classification  of  different  objects,  location  and  dimensional 
measurement  of  objects  to  subpixel  accuracy,  and  texture  analysis  such  as 
flaws  in  machined  or  painted  surfaces.  Familiarity  with  image  processing  will 
be  helpful  but  not  necessary. 

This  session  will  not  involve  a  rigorous  math  approach,  but  instead  its 
emphasis  will  be  on  gaining  an  intuition  on  how  the  application  of  various 
grayscale  and  binary  technique  can  successfully  handle  images  encountered  in 
adverse  environments  where  conditions  cannot  be  well  controlled. 


Many  of  today’s  machine  vision  hardware  systems  can  be  programmed  to 
take  advantage  of  the  methods  discussed,  which  will  range  from  simple  appli¬ 
cations  involving  erosion,  dilation,  and  skeletonizing  to  newer  morphological 
techniques  involving  vector  correlation  and  majority  voting  logic.  Other  topics 
to  be  covered  will  include  applications  where  binary  morphology  fails,  where 
linear  methods  will  fail,  how  to  do  thresholding  and  segmentation  correctly, 
tradeoffs  between  processing  time  and  robustness,  how  to  handle  moving 
images,  variation  in  illumination  levels  and  textured  backgrounds,  finding 
various  image  features,  and  the  transition  from  morphology  to  higher  level 
processing  concepts. 


Ir  or  each  ot  tne  important  application  categories,  a  n 


number  of  slides  will  be 


shown  illustrating  step  by  step  morphology  processing  from  the  input  camera 
image  to  the  final  recognition. 


Morphological  Signal  Processing  Systems 

C.  H.  Richardson  and  R.  IV.  Schafer 

Georgia  Institute  of  Technology 
School  of  Electrical  Engineering 
Atlanta.  Georgia  30332 


ABSTRACT 

This  talk  will  begin  by  reviewing  some  important  relationships  between 
morphological  systems  and  a  variety  of  signal  processing  transformations  that 
were  originally  developed  outside  the  framework  of  morphological  system 
theory.  This  discussion  is  intended  to  highlight  the  need  for  a  systematic 
approach  to  the  design  of  signal  processing  systems  that  are  based  on  the 
principles  and  fundamental  representational  theorems  of  mathematical  mor¬ 
phology.  A  second  aspect  of  the  talk  will  be  concerned  with  some  applications 
of  morphological  signal  processing  systems.  The  talk  will  conclude  with  a 
general  discussion  of  the  some  of  the  fundamental  problems  in  computer- 
aided  design  and  analysis  of  morphological  systems.  Specifically  discussed 
will  be  preliminary  research  on  developing  a  LISP-based  signal  processing 
environment  for  the  representation  of  discrete  signals  and  systems  for  both 
symbolic  and  numeric  manipulations  of  morphological  systems. 


Mathematical  Morphology  Applied  to  Multi-Scale 
Image  Representation  and  Shape  Description 

Petros  Maragos 
Division  of  Applied  Sciences 
Harvard  University 
Cambridge.  MA  0213S 


ABSTRACT 

Two  fundamental  problems  In  computer  vision  are  how  to  represent  image 
objects  at  multiple  scales  and  how  to  describe  their  shapes.  Mathematical 
morphology  is  a  formal  and  quantitative  methodology  to  image  analysis,  which 
directly  extracts  information  about  the  shape  and  size  of  image  objects.  As 
such,  it  can  offer  a  systematic  approach  to  solving  the  above  two  problems. 
Specifically  we  will  discuss  the  use  of  morphological  skeletons  for  a  very  gen¬ 
eral  and  versatile  multi-scale  image  representation  transform;  morphological 
openings  for  nonlinear  multi-scale  image  smoothing  and  a  derived  shape-size 
descriptor,  the  pattern  spectrum:  a  shape-size  approach  for  a  symbolic  image 
modeling  by  parts;  and  the  use  of  morphological  skeletonization  for  modeling 
fractal  images. 

Through  successive  erosions  and  openings  of  an  image  with  respect  to  an 
arbitrary  structuring  element,  a  sequence  of  small  critical  image  parts  can  be 
obtained,  called  skeleton  components,  whose  superposition  is  the  morphologi¬ 
cal  skeleton.  The  ensemble  of  all  skelet.n  components  can  exactly  reconstruct 
the  image  through  dilations.  Elimination  of  some  components  is  equivalent  to 
morphological  opening  (smoothing)  the  image  at  a  scale  equal  to  the  number  of 
eliminated  components.  By  also  varying  the  structuring  element,  multi-shape 
multi-scale  structural  distributions  in  images  can  be  modeled  by  skeletons  and 
openings  with  direct  applications  to  data  compression  and  progressive  image 
transmission. 

The  openings  can  also  complement  linear  smoothing  filters  used  in  multi¬ 
scale  image  analysis,  because  openings  can  suppress  noise  without  sniffing  or 
blurring  image  edges  and  axiomatize  the  concept  of  scale.  In  addition,  areas 
of  differences  among  successive  openings  create  a  useful  shape-size  descriptor, 
the  pattern  spectrum,  which  can  detect  critical  scales  in  images. 

Morphological  concepts  can  be  used  to  rigorously  formulate  a  symbolic 
image  modeling  problem.  Here  the  image  is  modeled  as  a  nonlinear  super¬ 
position  of  simpler  parts  (the  "symbols”),  which  are  translated  and  scaled 
shape  patterns  (structuring  elements)  drawn  from  a  finite  collection.  Then 


the  model  parameters  can  be  found  by  using  the  information  from  openings 
and  pattern  spectrum,  and  via  local  searches  at  points  of  generalized  skeletons. 
This  symbolic  modeling  appears  promising  in  bridging  the  gap  between  low- 
level  image  processing  operations  and  high-level  vision  tasks  such  as  object 
recognition. 

Finally,  in  the  theory  of  iterated  function  systems,  a  fractal  image  can  be 
modeled  arbitrarily  closely  as  the  attractor  of  a  finite  set  of  affine  maps.  We  use 
the  morphological  skeleton  to  efficiently  extract  the  parameters  of  these  affine 
maps.  This  technique  has  applications  for  fractal  image  analysis/synthesis, 
computer  graphics,  and  coding. 


5.  Discussion  at  Workshop 


Remarks  on  Morphology  Workshop  Panel  Discussion 
by  Stephen  Dow 

The  morphology  workshop  panel  discussion  brought  out  a 
number  of  issues  relating  morphology  to  Army  image  processing 
applications.  Some  of  the  general  types  of  processing  where 
morphology  was  identified  as  being  applicable  are  image 
enhancement  or  filtering,  shape  feature  extraction,  and  data 
compression.  Some  concern  was  expressed  that  the  shape 
detection  capabilities  of  the  morphological  operations  may  be 
more  applicable  to  images  from  manufacturing  applications  them 
to  those  from  Army  applications  because  in  the  former  case 
the  shapes  of  interest  tend  to  be  more  predictable  and  well- 
defined  than  in  the  latter.  It  may  be  the  case  that  the 
complex  imagery  involved  in  automatic  target  recognition 
applications  precludes  the  free-form,  interactive  selection 
of  morphological  operations  and  structuring  elements  which  will 
extract  desired  objects;  techniques  for  automated  selection  and 
optimization  may  be  necessary.  It  was  pointed  out  that 
mathematical  morphology  is  not  a  stand-alone  method  but  a  set 
of  tools  to  be  used  along  with  other  methods.  Even  if 
morphological  operations  cannot  directly  extract  the  objects  of 
interest  there  are  probably  portions  of  the  processing  which 
can  be  aided  by  these  operations  and  by  the  algebraic 
methodology  morphology  provides. 

There  was  also  some  discussion  relating  to  the  existence 
and  availability  of  image  data  bases  and  criteria  for 
performance  evaluation.  These  factors  are  important  to  the 
research  community's  ability  to  develop,  test,  and  demonstate 
the  applicability  of  morphological  methods  to  Army  imagery. 


APPLICATIONS  OF  MORPHOLOGY  IN  INDUSTRY 


Stephen  S.  Wilson,  Applied  Intelligent  Systems,  Inc. 

Many  of  the  tools  of  morphology  have  been  successfully  applied  in 
industrial  applications.  The  erosion,  dilation  opening  and  closing 
operations  are  useful  for  noise  filtering  and  for  recognizing  and  locating 
simple  shapes  defined  by  a  structuring  element.  Also,  a  wide  variety  of 
more  complex  but  useful  tools  fall  under  the  heading  of  "hit  or  miss" 
operations  such  as  topological  filters,  convex  hull,  skeletonizing, 
feature  finding,  conditional  dilation,  and  directional  filtering. 
Generalization  of  the  above  operations  to  fuzzy  logic  is  one  way  of 
extending  the  morphology  concepts  so  that  they  can  be  directly  applied  to 
grey  level  images.  Other  generalizations  such  as  majority  voting  logic 
are  useful  when  applied  to  noisy  images. 

Vector  correlation  is  similar  to  the  usual  concept  of  correlation,  but 
where  the  picture  and  kernel  are  vectors  multiplied  using  the  inner 
product.  In  morphology,  a  vector  structuring  element  can  be  defined  where 
the  basis  of  the  vector  space  is  a  number  of  feature  bit  planes.  Thus, 
morphology  can  be  used  for  relating  features  to  classify  objects. 

Industrial  applications  largely  fall  into  five  application  categories: 

1.  Classification,  such  as  character  recognition  using  vector  morphology, 

2.  Location;  finding  overlapping  parts  to  subpixel  accuracy  using  vector 
correlation, 

3.  Texture  defects,  such  as  finding  flaws  in  TV  screens  by  directly 
applying  openings  and  closings, 

4.  Dimensional  measurement,  where  morphology  is  used  to  locate  positions 
where  measurement  is  to  take  place,  and 

5.  Flaw  detection,  such  as  missing,  or  improperly  punched  holes  in  metal 
parts  . 

There  are  two  broad  classes  of  parallel  computer  architecture  used  in 
morphological  image  processing:  MIMD  (Multiple  Instruction,  Multiple  Data' 
systems  which  are  coarse  grained,  and  SIMD  (Single  Instruction,  Multiple 
Data)  systems  which  have  fine  grained  processing  elements.  The  most 
popular  types  of  MIMD  systems  are  pipeline  processors  where  a  large  number 
of  functional  modules  can  be  interconnected  to  form  a  real  time  image 
processing  system.  Examples  of  these  systems  are  the  ERIM  Cytocomputer , 
and  a  large  variety  of  cards  manufactured  by  Datacube  which  can  be 
configured  using  their  proprietary  Maxvideo  buss.  However,  these  systems 
can  be  bulky  and  expensive,  and  difficult  to  configure  in  the  field. 

The  most  popular  type  of  SIMD  architecture  is  the  mesh  connected  system 
where  a  large  number  of  simple  processing  elements  are  connected  in  an  NxN 
two  dimensional  grid  such  as  in  the  GAPP  chip  manufactured  by  NCR. 

Although  these  systems  are  superb  at  morphology,  the  data  I/O  tends  to  be 
quite  complex,  and  existing  systems  are  large  and  expensive.  The  Applied 
Intelligent  Systems  Inc.  AIS-5000  is  an  industrial  system  with  a  one 
dimensional  array  of  moderately  complex  processors.  The  Centipede  is  an 
evolution  of  the  AIS-5000  which  is  small,  low  cost,  and  more  powerful,  and 
is  a  candidate  for  an  automatic  target  recognition  system. 


6.  Letters 


August  1 ,  1 988 


Dr.  Robert  M.  Haralick 

Boeing  Clairmont  Egtvedt  Professor 

Department  of  Electrical  Engineering 

University  of  Washington 

402  Electrical  Engineering  Building  FT-10 

Seattle,  Washington  98195 

Dear  Dr.  Haralick, 

The  workshop  last  week  has  aroused  interest  in  the  potential 
that  morphology  shows  for  use  on  several  NASA  programs.  Projects 
at  the  Marshall  Center  that  may  benefit  from  its  application 
include:  vision  sensor  driven  off-line  programming  of  a  robot  for 
Solid  Rocket  Booster  refurbishment;  vision  guided  rendezvous  and 
docking  for  an  autonomous  satellite  service  vehicle;  and  the 
capture  of  a  CAD  data  base  via  the  use  of  3D  Computed  Tomography 
CT  data.  The  last  application,  in  particular,  is  interesting 
since  it  would  require  the  extension  of  morphological  techniques 
to  3D  images,  and  it  could  have  widespread  use  in  industry. 

Thanks  again  for  organizing  such  an  interesting  and  timely 
conference.  I  look  forward  to  receiving  the  post-workshop  report. 

Sincerely 

Ken  Fernandez,  Ph/t). 
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1)  On  25  and  26  July  I  attended  the  Morphology  Workshop  at  the 
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morphology  algorithms  in  the  discrimination  process  would  be  a  fertile 
area  for  investigation. 
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7.  Recommendations 

It  is  clear  from  the  discussions  at  the  workshop  that  mathematical  morphology  is  an 
important  image  analysis  tool  that  has  applications  not  only  in  industry  but  also  in  smart 
sensor  systems.  This  is  confirmed  by  the  letters  of  section  6.  It  would  be  worthwhile  for 
some  basic  and'DOD  applied  research  to  be  sponsored  in  this  area. 
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Design  of  signal  processing  systems  may  be  facilitated  by 


symbolic  manipulation  of  signal  processing  expressions. 


Basic  Set  Operations 

Shifted  Set:  (X)&  =  {z  :  2  =  x  +  6;  x  E  X} 

Complement  Set:  (A')c  =  {z  :  z  £  X) 

Symmetric  Set:  B  —  {z  :  z  —  —6;  b  E  B} 

Minkowski  Sum: 

XQB  =  {z  :  z  —  x  +  b:x  E  X,  b  E  B} 

=  U  {X)b=  u  (£)*  =  XeB 

beB  x€X 

=  {z:Xn(B)z^ti} 

Minkowski  Difference: 

xes  =  (xce b)c=  n  {x)b 

beB 

=  {z  :  {B)z  C  X}  =  {z  :  z  —  b  E  X\b  E  B} 


Duality:  XQB  =  {Xc  0  B)c ;  X  Q  B  -  (Xc  ©  B)c 


>  i 

1 

Basic  Morphological  Systems  : 

Dilation:  D{X,  B)  =  X  0  B  =  {z  :  X  n  (B)z  ±  0}  i 

Erosion:  £(X,B)  =  X  G  B  =  {z  ■.  (B)z  C  X} 

Duality: 

£{X,B)  =  XeB  =  {XceB)c^[P{Xc.,B)]c 
D{X,  B)  =  X  Q  B  =  {Xc  G  B)c  =  [D(XC,B)\C 

Opening:  0(X,  B)  =  (X  Q  B)  ©  B  =  !?(£ (X,  B),B) 

Closing:  C(X.  B)  =  (X  ©  B)  9  B  =  £(D(X,  B),B) 

Duality:  O(.Y.B)  =  !C(XC,  B)!c:  C(X,B)  =  [0(Xc,B)]c 

Open-Closing:  OC{X,B)  —  C(0(X,  B),  B) 

Close-Opening:  CO(X,B)  =  0(C(X,  B).  B) 

/INJ^vro*  "Pr\r  cvmmptrtr  ctriirturincr  plpmpn  tc  R  “  R  yvp  ran 

■«  W  J.  V*.  J  *.*****.-  ».  j.  *-■*.  J.  v^v.  V.  -*■*■*-,  ...... . .  —  ~  ^  ~  ' 

drop  the  '  and  all  definitions  of  morphological  operators  give 


the  same  results.) 


Properties  of  Morphological 

Systems 

Increasing:  For  example, 

If  Xi  C  X2,  then  £{XUB)  C  £{X2)B) 
Translation  Invariant:  For  Example, 

D((X)Z,B)  =  [D{X,B)\Z 
Extensive/ Antiextensive: 

£{X,B)  C  0(X,5)  CIC  C(IB)  C  P(IB) 
Idempotence: 


0{Q(X.B).B)  =  O(A'.B) 


C(C{X,B),B)  =  C(A’J) 


Systems  for  Thinning  -  I 


Hit  or  Miss  Operator: 

Assume  B  =  {B\.B2)  where  B\  and  B2  are  disjoint  sets. 

X{X,B)  =  {XeBl)/[X@B2) 

=  {z  :  z  €  (X  Q  Bi)  and  2  0  (X  G  B2)j 

=  (X  e  50  n  (x  ©  b2)c  =  {x  ©  50  n  (xc  a  52) 
-  £(xs£0n£(xc,£2) 


The  hit  or  miss  operator  selects  the  set  of  points  for  which  Bx 
is  inside  the  image  and  B2  is  inside  the  background. 


Systems  for  Thinning  -  II 


Skeleton: 

The  skeleton  S(X)  of  a  binary  image  is  defined  as 
Sn(X)  =  £(X,nB)/0(£(X,nB),B) 

for  n  —  0, 1, . . . ,  N . 

S(X)  =  u  Sn(X) 

n=0 

The  original  image  can  be  reconstructed  from  the  skeleton  sub¬ 
sets  by 

x=  u  D{S„{X),nB) 

n= 0 


Representing  Functions  by  Sets 


•  Functions  can  be  represented  by  sets. 

FUNCTION  CROSS-SECTION  UMBRA 


*  min  and  max  are  isomorphic  to  intersection  and  union. 


(/  A})(i)  =  min[/(i),g(i)]  <£=>  U(f)j/)U(g) 
(f  V  g)(x)  =  max\f(x),q(x)}  <=>  U(})(f\U(q ) 
fix)  <  glx)  Vi  <=>  Uif)  C  U(g) 


Morphological  Systems  for  Functions 


Minkowski  Sum: 

(/  ©  9){x)  =  max[/(z)  +  g(x  -  z) j 
Minkowski  Difference: 

(/  ©  g)(x)  =  min[/(z)  -  g{x  -  z)j 

Dilation: 

£(/>  ?)(*)  =  (/  ©  s)(z)  =  rnpj/(z)  +  g(z  -  x)j 
g(x)  =  g(—x)  (reflected  function) 

Erosion: 

£  (/.?)(*)  =  (/  ©  <?)0)  =  min[/(z)  -  g(z  -  z)j 

Opening  and  Closing: 


0{f,g )  =  0(£{f.g),g) 


C[f,g)  =  £{P{f,g),g) 


Morphological  Filtering 


©  Morphological  systems  can  be  used  to  smooth  functions. 


ORIGINAL  FUNCTION 


EROSION  Br  SET  B  C IBI*SD 


DILATION  BY  SET  B  CIBI-S3 


OPENING  BY  SET  8  CIBI-S3 
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] 
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CLOSING  BY  SET  B  CIBI*53 


Morphological  Signal  Analysis 


Top  Hat  Operator; 


T(f,B)(x)  =  f(x)-0(f,nB)(x) 


ORIGINAL  FUNCTION 


EROSION  BY  SET  B  CIBI-SD 


OPENING  BY  SET  B  CIBI-SD 


Systems  for  Thinning  -  III 


Edge  Detection: 


The  edges  of  a  binary  image  can  be  extracted  using 
of  the  form 


7{X,nB)=X/£{X,nB) 


where  B  is  a  small  symmetric  structuring  element 


For  greyscale  images,  the  corresponding  operator  i 


7(f,nB)=f-£(f,nB) 


an  operator 


Rank-Order  Systems  -  I 


Consider  a  system  with  input  f(x)  such  that  the  output  signal 
£&(/,  B)(x)  is  obtained  by  sorting  the  values  of  the  input  subset 
{f(z):zE  Bx}  and  assigning  the  fcth  number  in  the  resulting 
list  as  the  output  value.  (Assume  N  is  the  number  of  points  in 
the  set  B.)  Then 

£1  if>B){x)  =  min[/(*)]  =  £(f,B){x) 

z£Jdx 

RN{f,B)(x)  =  max[/(z)]  =  P(f,B){x) 

B(x)  =  median  [f(z)  for  z  G  Bx] 


Rank-order  systems  are  increasing  and  translation-invariant. 


Rank-Order  Systems  -  II 


The  fcth  rank-order  system  with  structuring  set  B  (window) 

is  equivalent  to  a  union  of  erosions  by  all  the  subsets  of  B 

containing  k  points.  For  example,  consider  a  3-point  median 
filter. 


M3(/,B)(x)  =  median  [f{x  —  l),/(i),/(x  +  1)J 


—  max 


min[/(x-  l),/(i)j 
min(/(i-  l),/(s  +  l)j 
min!/(z),/(z  +  1)] 


Rank-Order  Systems  -  III 


Relations  to  other  morphological  systems: 


ORIGINAL  FUNCTION 


CLOS  -  OPEN INC  BY  L  CILl*3) 


OPEN  -  CLOSING  BY  L  C I L I =30 


MEDIAN  ROOT  W.R.TO  B  (IBI*S) 


3 


Kernel  Representations  -  I 


Consider  an  increasing  translation-invariant  system  ty(X).  The 
kernel  of  this  system  is  defined  to  be  the  collection  of  sets 

Kern(tf)  -  {A:0eV(A)} 

where  0  is  the  origin. 


Any  increasing  translation-invariant  system  can  be  exactly  rep¬ 
resented  as  a  union  of  erosions  by  all  its  kernel  elements;  i.e.. 


*(x)=  u  e{x,B) 

B€  Ke;-n(^) 

In  general  the  kernel  may  contain  an  infinite  number  of  ele¬ 
ments,  but  sometimes  it  is  possible  to  represent  a  system  with 
only  a  finite  subset  (basis)  of  the  kernel  elements. 


Kernel  Representations  -  II 


For  function  processing  systems,  the  analogous  result  is 

Recall  the  example  of  the  previous  3-point  median  filter. 
M3(f,B)(x)  =  median  (/(x  —  +  1)] 


=  max 


min[/(x  -  l),/(x)] 
n»in[/(x  -  l),/(s  +  1)1 
min  [f(x),f{x+  l)j 


=  ma x[£(f,B,)(x)\ 

where  B  =  {  —  1,0,1},  Bi  =  {-1,0},  B 2  =  {  —  1,1},  and  Bz 
{0, 1}.  Thus  the  kernel. of  the  3-point  median  filter  is 


Kern(M3)  =  {B1,B2,B3) 


Kernel  Representations  -  III 


Which  systems  have  finite  kernels? 

•  Basic  morpholo'  al  systems  -  erosion,  dilation,  opening, 
and  closing. 

®  Rank-order  systems  including  median  filters. 

•  An  interesting  class  of  linear  shift- invariant  systems. 

®  Wilcoxon  filters  -  combination  of  median  and  linear  filters 
(Crinon). 

•  Shape  recognition  window  transformations  (Crimmins  and 
Brown). 


Design  of  M orphological  Systems 


•  Powerful  theory  -  much  structure. 

•  How  do  you  specify  a  desired  system? 

•  How  do  you  synthesize  a  system  meeting  given  specifica¬ 
tions? 

*  Can  you  find  a  kernel  basis? 

•  How  do  you  find  the  most  efficient  implementation  for  a 
given  architecture? 


Morphological  Signal  Processing  Systems:  Part  II 


•  Application  of  morphology  to  FLIR  images 

•  Concerns  of  computer  aided  morphology 

•  Introduction  to  LISP 

•  Numeric  and  symbolic  processing  of  morpho¬ 
logical  expressions 


Forward  Looking  Infra  Red  (FLIR)  images  are 
characterized  by: 

•  compact  light  (concentrated  heat)  regions 
corresponding  to  man-made  objects 

•  darker  (cooler)  background 

•  light  distractions  such  as  a  forest  or  trees 

•  poor  contrast 

•  no  precise  geometrical  cues 


unknown  object  size 


The  top  hat  transformation  is  defined  as: 


ftopnL(x)  =  (/  -  max{/nio, /nLgo})(x) 

where  n  is  an  integer  multiplier  and  Lq  and  Lqq  are 
horizontal  and  vertical  line  structuring  elements, 
respectively,  centered  at  the  origin  and  having 
overall  length  equal  to  3,  i.e.,  ||Lo||  =  H-Lgoll  —  3. 


To  exploit  the  high  contrast  of  the  man-made 
object  a  simple  approximation  to  the  gradient  is 
defined  as: 

G(x)  =  (/  0  B)(x)  -  (/  ©  B)(x) 
where  a  rhombus  of  size  1  was  used  for  B. 


The  top  hat  transformation  with: 


\\nL0\\  =  !|nL90||  =  2n  +  1 

separates  the  compact  areas,  whose  largest 
dimension  (height  or  width)  is  less  than  2 n  -f-  1, 
from  the  larger  non-compact  areas  such  as  a 
horizontal  band  or  a  forest. 


The  object  location  is  found  by  taking  the  mean  of 
the  grey  scale  maximum  locations  of  the  gradient 


x 


where  M  is  the  number  of  times  the  maximum  grey 
scale  value  is  found,  xj-  is  the  location  of  the  kth 
maximum  and  x  is  the  desired  locaition.  If  there  is 
only  one  maximum  in  the  image  then  a  point  on 
the  edge  of  the  object  is  acceptable. 


By  using  a  slightly  different, 
transformation  of  the  form: 


top  hat 


(ftopnL){x )  —  (/  max{  fnJ^Q  >  fnLgo  5  /71L45  ’  ^nLi35  })  ix) 

one  may  suppress  some  of  the  noise  in  the  top  hat 
images  since  this  step  more  cleanly  separates  the 
object  from  the  whole  image,  making  the 
subsequent  gradient  processing  less  susceptible  to 
false  peaks. 

JL 


The  processing  steps  for  the  FLIR  data  were: 

•  Close  with  rhombus  of  size  1 

•  Sequence  of  Top  Hat  Transformations 

•  Find  maximum  of  gradient 

•  Average  maximum  locations  to  find  object 


SUMMARY 


sequence  of  top  hac  transformations  coupled 
with  gradient  processing  able  to  locate  single 
man-made  object 

by  changing  the  method  of  object  location 
selection  one  can  locate  an  arbitrary  number 
of  objects 

FLIR  object  detection  can  not  be  solved  using 
solely  these  methods 

require  additional  information  for  more 
complete  solution 


Computer  Aided  Morphology  -  CAM 


How  does  one  select  the  sequences  of  operations  to 
perform  a  task? 

Serra  suggests  five  rules  for  organizing  sequences 
of  morphological  operations: 

•  Review  possible  modes  for  information 
reduction  (i.e.  reducing  a  structure) 

•  Order  commutative  processes  so  the  largest 
simplification  is  made  first 

•  Determine  groupings  of  useful  interconnected 
operations 

®  Minimize  the  effects  of  interaction  of  sequen¬ 
tial  operations 

•  Remember  that  it  is  possible  to  back-track  to 
regain  lost  information 


Requirements  for  computer  aided  morphology  in¬ 
clude: 


•  Representation  of  reference  properties 
operations 

«  Method  of  selecting  operations  based 
assessment  of  properties 

<*  Means  of  interpreting  user’s  requirements 

©  Heuristic  knowledge  of  operations 
structuring  elements 


of 


on 


and 


Introduction  to  List  Programming 
(Common  LISP) 

•  Fundamental  structures  are  word-like  objects 
called  atoms 

•  Groups  of  atoms  form  sentance-like  objects  called 
lists 

•  Atoms  and  lists,  collectively,  are  called 
symbolic  expressions 

»  Compound  data  objects  and  procedures  are 
lists  and  can  be  used  interchangably 


Symbolic  Expression  Examples 


Atoms  may  be  numbers  or  symbols: 

•  3.1415,  ATOM,  SYMMETRIC-STRUCTEL 


Lists  consist  of  a  left  parenthesis,  followed  by  zero 
or  more  atoms  or  lists,  followed  by  a  right 
parenthesis: 

•  (THIS  IS  A  (LIST)),  (3.1415) 


Expressions  are  typically  lists  whose  first  element 
is  the  name  of  a  procedure  to  be  evaluated,  or 
executed: 


(+  (/  4  2)  (-  7  3)),  (MAX  POINT1  POINT2) 


Built  in  features  of  LISP  include: 

»  Numeric  primitive  operations  such  as 
+  ,  — ,  X  , 

•  Floating  point  and  integer  arithmetic 
capabilities 

•  Symbolic  primitives  for  list  processing  such  as 
CAR,  CDR 


•  Ability  to  evaluate  arbitrary  lists 


Symbolic  and  Numeric  Manipulations  of 
Morphology  Expressions 

Features  that  a  system  for  manipulating 
expressions  should  possess  include: 

•  Numeric  processing  of  expressions 
(i.e.  computation  of  an  erosion) 

•  Symbolic  manipulation  of  an  expression  (i.e. 
simplification  of  sequence  of  operations) 


In  our  work  the  symbolic  system  surrounds  the 
numeric  processing  core. 


The  numeric  manipulation  of  expressions  requires: 

•  Natural  signal  representation  (abstract  data 
objects) 

•  Inquiry  operations  for  extracting  signal 
information 

•  Functional  specification  of  useful  operators  (i.e. 
erosion,  dilation,  .  .  .) 


A  representation  of  signals  for  numerical  process¬ 
ing  should  be  based  on  the  following  observations 
of  signals: 

•  Signals  are  immutable 

•  Signals  are  identified  and  distinguished  by  their 
region  of  support  and  sample  values. 

•  Signals  are  organized  into  signal  classes 

•  Signals  exhibit  deferred  evaluation 


By  considering  a  sine  wave  to  be  a  function  of  three 
variables  (  a <p,  and  N)  we  can  define  the  class  of 
sinusoids  by: 

xuj,ip,Nln}  —  sin  (co  ■  n  +  <p)  :  n  =  1,  .  .  .  ,  N 

Any  particular  sinusoid  may  be  formed  by  binding 
parameters  with  actual  values: 


Setting  co  =  — <p  =  and  N  —  10  generates 

•  /  2  7 T  .7T\  ^  ir\ 

sin  •  n  H - )  :  n  =  1,  .  .  .  ,  10 

7  4 


The  notion  of  signal  classes  naturally  leads  to  sub 
classes,  generating  a  hierarchy  of  signal  classes. 

As  an  example,  zero-phase  sinusoids  form  a  sub 
class  of  sinusoids: 

xu>,iv[n]  —  s'in  (u  '  n)  :  n  —  1,  •  •  • ,  N 


Specification  of  a  signal  class  requires: 

•  Name  for  the  class  (i.e.  sine-wave) 

•  Parameters  for  distinguishing  specific  signal 
instances 

•  Functional  specification  for  computing 
samples 

•  Parent  type  for  property  inheritance 

•  A  signal  finder  for  creating  specific  signals 


Annotated  terminal  session  defining  the  CONSTANT  signal  class: 

(1)  :  (defsigtype  constant  parameters  (length  sample-value) 

:a-kind-of  basic-signal 
:finder  signal-constant 

:init  (dimension  length) 

: fetch  ((n)  sample-value)  ) 

==>  CONSTANT  ;  returns  the  class  name 


(2)  : 

(signal-constant  10  1) 

;  create  a  signal  instance 

“> 

SIGNAL-1 

;  returns  unique  name 

(3)  : 

(signal-fetch  signal-1 

3)  ;  request  sample  at  n  =  3 

==> 

1 

;  value  of  sample  at  n  =  3 

(4)  : 

(signal-what  signal-1) 

;  inquire  about  signal-1 

==> 

(signal-constant  10  1) 

;  returns  the  definition 

(5)  : 

(signal-constant  10  1) 

;  re-specify  the  signal 

==> 

SIGNAL-1 

;  signal  name  is  unique 

Symbolic  Manipulations 

Rule  based  systems  provide  a  flexible  mechanism 
for  representing  morphological  knowledge  for: 

•  Expression  simplification 

•  Generation  of  equivalent  forms 


Sample  manipulation  rules 


(Open-Idempotence 
( :  FORM 

(OPEN 


;  Rule  name 

;  If  the  input  matches  this  form 
(OPEN  7IMAGE  ?SEi)  ?SE2)  ) 


(:TEST  ;  and  satisfies  this  condition 

(SE1  OPEN  WR/T  SE2)  ) 

(:RESULT  ;  Then  replace  input  with  result 

(OPEN  IMAGE  SE1)  )  ) 


(Eros ion-of - struct el -union 

(:F0RM  ;  The  input  form 

(ERODE  ? IMAGE  (UNION  ?SE1  ?SE2))  ) 

(:RESULT  ;  The  equivalent  output  form 

(INTERSECT  (ERODE  IMAGE  SE1)  (ERODE  IMAGE  SE2) )  ) 


Simplirication  Example 


(1)  :  (SIMPLIFY  '(CLOSE 

(OPEN 

(OPEN  SIGNAL-1  LINOOO) 
VECOOO  ) 

RHOMBUS  )  ) 

==>  (FOUND  RULE  -  OPEN- IDEMPOTENCE) 


System  has  found  a  rule  and  applied  it 

==>  (CLOSE  (OPEN  SiGNAL-1  LINOOO)  RHOMBUS) 


Evaluate  the  expression 


(2)  :  (EVAL  ’(CLOSE  (OPEN  SIGNAL- 1  LINOOO))) 


Return  the  resulting  signal  object 
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APPLICATIONS  OF  MORPHOLOGY 


IN  INDUSTRY 
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1 . 0 


MATHEMATICAL  MORPHOLOGY 

IS  A  MATHEMATICAL  MODEL  ADDRESSING  THE  NEED  TO 
ANALYZE  PICTURES  TO  GAIN  KNOWLEDGE. 

IT  IS  A  SET  OF  TOOLS.  FOR  A  PARTICULAR  PROBLEM, 
THE  METHOD  WILL  SELDOM  TELL  YOU  EXACTLY  WHAT  TO 
DO,  OR  HOW  TO  DO  IT  -  THE  USER  MUST  GAIN  AN 
INTUITION  FOR  THE  STRENGTHS  AND  WEAKNESSES  OF  THE 
METHOD,  AND  DECIDE  FOR  HIMSELF  WHICH  TOOLS  TO  USE. 


1 . 0 


THE  FIRST  OBJECTIVE  OF  THIS  COURSE  IS  TO  FOCUS  ON 
THE  VARIOUS  TOOLS  FROM  AN  INTUITIVE  POINT  OF  VIEW. 

A  RIGOROUS  MATHEMATICAL  INSIGHT  IS  OPTIONAL  IN  USING 
THESE  TOOLS,  BUT  CAN  COME  LATER  BY  STUDYING  THE 
LITERATURE  ON  THE  SUBJECT.  A  KNOWLEDGE  OF  SET 
THEORY  AND  BOOLEAN  ALGEBRA  WOULD  BE  REQUIRED. 

A  SECOND  OBJECTIVE  IS  TO  UNDERSTAND  HOW  THE  TOOLS 
CAN  BE  APPLIED  TO  VARIOUS  CATEGORIES  OF 
APPLICATIONS  -  FOR  SPECIFIC  APPLICATIONS,  WHICH 
TOOLS  WORK  WELL,  AND  WHICH  DO  NOT. 


1 . 0 

THERE  ARE  SOME  APPLICATIONS  WHERE  THE  TOOLS  OF 
MATHEMATICAL  MORPHOLOGY  ARE  NOT  APPROPRIATE. 

WE  WILL  FOCUS  ON  THOSE  APPLICATIONS  THAT  DO  WORK. 

MORPHOLOGY,  AT  ITS  BEST  IS  MIXED  WITH  OTHER 
TECHNIQUES.  THESE  OTHER  TECHNIQUES  WILL  BE 
DISCUSSED  WHEN  THEY  HAVE  RELEVANCE  TO  THE 
PRINCIPLES  OF  MORPHOLOGY. 
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Pfr&ES  3-7 


2.  1 


? 

I 


EROSIONS 


r  e 


l  h 


h 


i  r 


!  ! 


1  =  1  mage 
Eros l on : 


S  =  structuring  element 

i  e  s  =  n  i 


S ;  eS 


-  C- 
'i 


note:  subscript  means  translate 

Image  I  eroded  by  structuring  element  S  means 
wherever  S  -fits  in  I,  mark  the  center  of  S  on  I. 


!.  1 


I 


DILATIONS 


Dilation  I  (+)  S  =  Is, 

s.  eS 
» 


A  A 

Wherever  the  center  of  S  hits  I,  mark  S  on  I 
or  wherever  S  to  *ches  I  ,  mark-  the  center  of 
S  on  I  . 


i 


(r  K  ft 

;/  * J 


-  •*.< 
’!  \Jr 


.*5 


t 


l 
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erosion  examples 
FICTITIOUS  program 


SYSTEM- INIT 
BLACK-DOT 
- LOOK 


E+ 

LOOK 

BLACK-DOT 


E-O 

LOOK 


BLACK-DOT 


Iff/ 

•,  f;  i  . ,  ' 

«/sv 


3.3  -i4- 


SYSTEM-INIT 


2.  4 


OTHER  OPERATIONS 

-  Hit  or  miss  (Serra  1982) 


Two  structuring  elements: 

H  =  “Hit"  c 

M  =  "Miss"  J 

I  f  S  =  {  i:HcI;  MCI=  > 

i.e.  the  transformed  pixel  is  "1" 
i -f  H  is  included  in  the  object  foreground 
and  M  is  included  in  the  object  background. 

Thus,  erosions  only  use  AND  operations, 
dilations  only  use  OR  operations, 
hit  or  miss  uses  both  operations. 

There  are  many  important  examples. 
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2.4. 1 


i  . 

■  * 

TOPOLOGICAL  FILTERS 

* 

A  "PLUG"  will  cause  a  kind  o-f  dilation,  but  it 
!  will  dilate  pre-f  erent  i  al  1  y  into  areas  for  which 

f  white  is  concave  on  black.  These  figures  show  the 

‘  effect  of  PLUG  on  swiss  cheese:  the  holes  ar 

,  filled  up  while  the  outer  dimensions  of  the  c 

stays  the  same. 

Formula:  PLUG ( I )  =  C  OR  (  AND  N> 

neigh 

,  SYSTEM- IN I T 

AQU I RE-CAMERA 

r 

SILHOUETTE 

LOOK - 

PLUG 
PLUG 

LOOK  - - 

PLUG 
PLUG 

'  LOOK 

!  END 


I 
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CONVEX  HULL 

Put  a  rubber-band  around  the  object. 


e 


CONVEX  HULL  SIMPLIFIED 

The  plug  operation  repeated  enough  times  will  put 
a  box  around  the  object. 


I 


SKELETONIZE  OR  THINNING 


2.4. 


A  type  o-f  erosion  except  the  last  dot  or  thinnest 
line  does  not  erode  away  completely. 

(i.e.  maintain  the  connectivity  ) 

Features  such  as  end  points  and  tee  connections 
become  apparent. 

Cannot  be  done  in  one  3>:3  structuring  element. 
Must  use  4  elements  in  succession:  thin  N,  S,  E, 
and  W.  Must  be  repeated  depending  on  the 
thickness  o-f  the  object. 
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2.4.4 


FEATURE  FINDING  FUNCTIONS 

Blank  out  image  except  where  there  is  the 

specified  feature.  Useful  after  skeletonizmo 
operations.  y 

Find  dot  -  there  is  an  isolated  pixel. 

no-  :~~TT~) 

Find  line  -  the  middle  of  a  line  segment. 


yes—  fT  i  1  i.i 
- -  -H 

i  I 


no—  i  r 


Find  end  point  -  of  a  line  segment. 


yes- 


no—* 


□ZG 


Find  tee  connection 


yes- 


no— 


Find  four  connection. 


yes- 


Zthe°a£ove/lndin9  fUnCti°nS  c»"  combinations 
e.g.  find  line  OR  end  ooint. 


1 1 


COVARIANCE 


2.4.5 


This  is  a  large  -field.  We  will  not  go  into 
details  in  this  course.  Need  a  knowledge  o-f- 
statistics. 

Ex amp 1 es . 


mi  55  — 

Chords  o-f  sire  N. 

hit 


Set  covariance  o-f  size  N 


c 

^ —  hit 


u 

s 


Use  various  angles  and  sizes.  Tally  results. 

Look  at  statistics. 

Good  -for  classi-fying  textures  such  as  in  polished 
mineral  cross-sec t i ons ,  or  wood  grain. 


zz 


2.4.6 


CONDITIONAL  DILATION 

Two  bitpianes  are  involved: 

A  "mask"  or  condition  plane  which  will 
not  be  altered. 

An  "object"  plane  where  pixels  are  to  be 
di 1 ated . 


The  object  is  generally  smaller  than  the  mask. 


The  transformation:  dilate  the  object  plane 

under  the  condition  that  it  does  not  grow  outside 
the  bounds  o-f  the  mast:. 


JL1}- 
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n  CT 


PRINTED  CIRCUIT  BOARD  INSPECTION 


under —etched 


Inspection  by  rule,  ^ 

To  look  at  lead  quality,  open  with  a  small  disk. 


To  look  at  spacing  between  leads,  close  with  a 
small  disk. 

"hen. 

"rev'  d  c  <~e  c~.t  z  f  . 


Z4 


2.  5.  4 


DIRECTIONAL  FILTERING 

Problem:  Thresholding  after  edge  detection  of  a 

low  contrast  noisy  picture  results  in  a  noisy 
binary  image.  Raising  the  threshold  causes  a  loss 
of  the  image  along  with  intended  loss  of  noise. 

Morphol ogi cal  filtering  by  opening  or  closing 
fails  because  of  the  noise  density. 


An  effective  solution: 

Create  separate  bit  planes  for  the  eight  different 
edge  directions. 

Threshold  them  separately  with  the  same  threshold. 
The  density  of  pixels  around  edges  remains 
constant  for  the  corresponding  direction  plane. 
The  density  of  random  noise  drops  by  a  factor 
of  eight  so  that  morphological  filtering  is 
now  more  effective. 

Filter  each  direction  plane  separately. 

Combine  into  one  plane  if  desired  by  an  OR  of  the 
eight  direction  planes. 
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FUZZY  LOGIC 


3.  1 


Fi rst,  Ari stotei 1  an  logic: 


Two  values  -  true  or 


A 

B 

AND 

OR 

0 

0 

0 

0 

0 

1 

0 

1 

1 

0 

0 

1 

1 

1 

i 

1 

Truth  tables 


false  =  1  or  0. 


A 

NOT  A 

0 

1 

1 

0 

Fuzzy  logic  -  continuous  values  0  -**  1 
0  =*>  False 
.  2  =>  I  doubt  it 
.5  =?>  Maybe,  maybe  not 
.  8  =■*  I  think  so 
1.  =?  You're  darn  right 


Gperat i on 


Repl  acement. 


A  AND  B 
A  OR  B 
NOT  A 


MINIMUM (A, B> 
MAX IMUM  <A,B> 
1  -  A 


De  Morgan's  rule  still  works 

Binary:  A~  AND  ~B  =  A  OR  B~ 

Fuzzy:  MIN<1-A,1-B)  =  1  -  MAX (A,B) 


All  other  common  theorems  in  boolean  logic 
also  hold  with  the  above  replacements. 
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FUZZY  LOGIC  APPLIED  TO  MORPHOLOGY 


T  4 

O  «.  1 


The  grey  level  intensity  is  a  fuzzy  logic  state. 


Binary  morphology  operations  have  a  direct 
fuzzy  counterpart. 


Di 1  ate: 

Erode: 

Plug: 


OR(nbhd) 

AND (nbhd ) 
cen  OR  AND (nbhd) 


MAX (nbhd) 

MIN (nbhd ) 

MAX (cen ,MIN (nbhd ) ) 


What  is  a  ''fuzzy 


thr eshol  cf? 


3.  1 


IMPORTANT  ISOMORPHISM 

fuzzy  ops  threshold 

grey  image  - grey  image  - r  binary  image 


threshold  binary  ops 

grey  image  - ►binary  image  - ^binary  image 


The  resulting  binary  image  is  the  same  in 
both  cases! 

Fuzzy  logic  is  useful 

when  the  threshold  is  adaptive  or  uncertain; 
when  combined  with  arithmetic  operations. 


3/ 
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BEYOND  MORPHOLOGY 


The  -following  operations  strictly  do  not  belong 
a  discussion  of  morphoi  ogy .  However,  some 
principles  are  related,  and  they  are  often 
necessary  to  use  along  with  morphology  in  order 
successfully  develop  solutions  to  some  image 
processing  problems. 


4.  1 


IMAGE  ALGEBRA 


Supported  by  the  Air  Force  and  DARPA. 
Under  development  at  the  University  of 
The  objective  is  to  be  able  to  express 
leve)  i mage-to-i mage  transformations  , 


FI  or i da . 
all  grey 


4.2 


MAJORITY  VOTING  LOGIC 


Similar  to  2-D  erosions. 


Object  with 
pixel  dropouts 


Structuring  element 
will  not  fit. 


This  object  will  not  be  detected  with  an  opening. 


Majority  vote: 

Allow  a  95%  fit  of  the  structuring  element  to  vote 
for  a  hit. 


Noise  dropouts  can  then  be  tolerated. 

The  percentage  vote  is  a  variable  to  be  adjusted 
to  give  good  performance. 

A  100%  vote  is  equivalent  to  an  erosion. 
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CONVOLUTION 

DEFINITION 


MOVE  THE  KERNEL  WINDOW  OVER  THE  ENTIRE  IMAGE  AND 
COMPUTE  THE  SUM  OF  PRODUCTS  FOR  EACH  PIXEL. 


OBOL  OPERATOR 


4 
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U 


04  n  -< 

04  04  04 


Vi  Vi 

0 4  04  04 

04  -0 

CD 

V)  r-4  04 

N  04 

O 

04  04  04 

N 

0* 

to  V) 

O  Si 

O 

N 

V)  <t  V 

—  V) 

1 

04  ro  «r 

> 
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u 

ID  -J 

0  CL 
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u 
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THE  SOBOL  OPERATOR  IS  AN  EDGE  DETECTOR 


5s)- 4-0 


laplacian  operator 
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LARGE  AREA  AVERAGE 


SUBTRACT  THIS  FROM  THE  ORIGIONAL 
IMAGE  FOR  A  HIGH  PASS  FILTER. 
THIS  IS  AN  EXTENSION  OF  THE 
LAPLACIAN  FILTER. 
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GAUSSIAN  CONVOLUTION 


VECTOR  CORRELATION 
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RELATED  CONCEPTS 
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Binary  i  Gray 

I 

( 
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OPERATION  HIERARCHY 
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5.0 


PROCESSING  TECHNIQUES  USING  MORPHOLOGY 
OR  OTHER  RELATED  OPERATIONS 


i  mage 


absolute 


constant  constant 

fraction  fraction  with 

noise  removal 


morphol ogy 


62. 
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THRESHOLDS 
FIXED  THRESHOLD. 


'AV«~ 


A  blurred  image  gives 
an  illumination 
dependent  width. 


Non-linear  -filtering  would  help  by  allowing  a 
lower  threshold. 

Linear  filtering  would  cause  more  blurring. 


1 


5.3 


THRESHOLD 
CONSTANT  FRACTION 

Assume  a  3: 1  ratio  of  reflectivity  of  objects  to 
background . 

Image 


Background 
low-pass  fi 

Normal i zed 
and 

background. 
Threshol ded 


The  threshold  has  the  same  relative  position  for 
different  illumination  levels. 

For  other  reflectivities,  first  multiply  the 
background  by  a  constant. 

To  prevent  noise  from  being  thresholded,  replace 
background  by: 

MAX (noise  threshold,  background) 


o  — ■'  —  —  —  —  —  —  — 

Noise  does  not  obey  the  laws  of  reflectivity! 


7o. 
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5.3 


THRESHOLD 

ADAPTIVE  CONSTANT  FRACTION 

What  if  reflectivity  difference 
i s  smal I 
is  not  known 
changes  over  the 

Image  after 
background 


\ 


Divide  dilated 
image  by  2. 

Compare  with 
original  image 


To  prevent  thresholding  noise,  use: 

MAX (  noise  threshold,  (dilated  image) /2) 


5.4 


BIT  PLANE  VECTOR  CORRELATION 

Vector  morphology.  A  type  of  erosion. 

In  the  usual  erosion  a 
structuring  element  is 
defined  and  the  AND 
operation  is  applied  to 
the  image  bitplane; 

or,  very  loosely.  I  0  S  =  AND  I 

c 


Is  ) 


In  vector  morphology,  the  image  is  several  bit 
planes  of  features,  say  two  features  FI  and  F2. 
The  structuring  element  also  has  multiple  states. 


Image 


Structuring  element 


I  3  S  =  (AND  FI)  AND  (AND  F2) 

51  SZ 

An  example  of  character  recognition  is  given  in  a 
later  section. 
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MaxVideo  image  Processors 


L  iTHE 

Am  MaxVideo 

•BP  |— A  1  ill\/ 


FAMILY 


DIGIMAX 


Performs  A/D  and  D/A  conversion  on  RS-170  (60Hz) 
and  CCIR  (SOHzt  standard  video  signals  in  real  time. 
Eight  camera  inputs  are  software  selectable.  32 
banks  or  input/output  Look-Up  Tables.  Three  output 
D'A  channels,  and  graphics  overlay  hardware  are 
provided. 


FRAMESTORE 


Three  complete  8-bit  512  x  512  stores  on  a  single 
board.  Can  be  utilized  as  three  independent  8-bir 
butters  or  as  one  16-  or  24-bit  deep  framestore. 
Extensive  multiplexing  tor  user  flexibility. 


MAX-SP 


Signal  Processor  performs  full  frame  single  point 
FIR  filtering  in  one  frame  time.  Multi-image  merging, 
differencing,  multiplier,  minimum/maximum  oper¬ 
ations,  ALU.  clipper  unit,  barrel  shifter  and  LUTs. 


VFIR 


Linear  pixel  processor  performs  3x3  two  dimen¬ 
sional  convolution  or  10  x  1  FIR  filter  on  512  x  512 
image  in  one  frame  time.  100  million,  20-bit  preci¬ 
sion  multiply  accumulates  per  second.  Full  20-bit 
precision  at  end  of  adder  tree. 


SNAP 


Real  time  non-linear  Systolic  Neighborhood  Area 
Processor.  Performs  180  million  8-bit  comparisons 
(10  million  neighborhoods)  per  second;  mathemati¬ 
cal  morphology:  erosion  and  dilation  algorithm 
implementation. 


PROTOMAX 


Wire  wrap  prototyping  module  for  developing 
MaxVideo  compatible  designs.  PROTOMAX  in¬ 
cludes  interface  circuitry  and  connectors  to  both 
MAXbus  and  PI  connector  of  VMEbus. 


'i  * 


Transposing  framestore  which  contains  two  com¬ 
plete  trames  ot  video  storage.  Each  frame  can  be 
read  and, or  written  in  row  or  column  order  to 
achieve  real  time  90  degree  image  transposition.  It 
is  useful  tor  realizing  separated  horizontal  and 
vertical  pipelines. 


INTERPOLATOR 


Stand-alone  \  ME  graphics  controller  supporting 
simultaneous  displav  ot  256  colors.  Has  unique 
capability  of  overlaying  graphics  with  real  time 
digital  video  signals.  Implements  primitive  opera¬ 
tions  for  a  variety  of  geometric  draw  and  fill  com¬ 
mands. 


MAX-SIGMA 


Performs  sub-pixel,  multirate  sampling  in  real  time. 
It  can  perform  first  order  transformation  in  one 
dimension.  Its  8-point  aperture  and  sine  interpola¬ 
tion  algorithm  vield  an  extremely  precise  16-bit 
result  in  conjunction  with  ADDGEN-1. 

ADDGEN-1 


Address  generator  module  which  works  in  conjunc¬ 
tion  with  the  INTERPOLATOR  module.  It  creates  the 
addressing  necessary  to  allow  INTERPOLATOR  to 
perform  first  order  transformations  to  32-bits  of 
spatial  resolution.  Sub-pixel  multirate  sampling 
module. 


Variable  aperture  lup  to  64  by  256)  moving  average 
convolution  module.  Performs  hipass,  low  pass  and 
band  pass  filters. 


FEATUREMAX 


Performs  histogram  and  feature  list  extraction  in 
real  time.  Feature  st  extraction  stores  the  x,  y 
coordinates  ot  up  to  16K  spatial  grey  level  specific 
events. 


MaxVideo  Image  Processors 
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Ad  MaxVideo 

FAMILY 


EUCLID 


High  speed  general  DSP  module.  Supported  by  an 
extensive  preprogrammed  "C"  callable  library  and  a 
complete  complement  of  development  tools  includ¬ 
ing  an  ANSI  standard  "C  compiler.  Concurrent 
data  movement  and  processing  and  MAXbus 
compatibility  lead  a  long  list  of  standard  features. 

ROI-STORE  - 


A  true  advancement  on  data/imaging  storage.  Rang¬ 
ing  in  capacities  trom  512K  bytes  to  2  megabytes 
ana  operating  on  user  defined  regions  of  interest. 
Hardware  supported  pan.  scroll  and  zoom  features 
allow  tor  greater  programming  flexibility. 

~M  AX-MUX  ~ 


MAX-MUX  is  a  digital  cioss  point  switch  for  the 
MAXbus.  Under  user  control  MAX-MUX  allows  for 
the  assembly  01  a  more  flexible  MaxVideo  based 
processing  system.  A  16  x  16  LUT  performs  any 
arbitrary  point  transformation. 


MAX-SCAN 


Analog  and  digital  acquisition  module.  Completek 
programmable  acquisition  rates  from  DC  to  20 
MHz.  Extensive  and  flexible  synchronous  options 
allow  interface  to  numerous  devices. 


VFIR-MK  II 


Second  generation  Video  Finite  Impulse  Response 
Filter.  Implements  a  64-point  arbitrary  coefficient 
convolution/correlation  on  a  10  MHz  stream.  640 
million  multipiv-accumulates  per  second  allows  tor 
real-time  8  x  8  or  64  x  I  operations. 

MAX-BOX  ~ 


Max-BOX  is  a  twenty  slot  VME  chassis  featuring  750 
watt  power  supply,  forced  air  cooling,  high  effi¬ 
ciency  plenum  design  and  standard  dual  height 
Eurocard  compatibility.  Designed  to  house  high 
performance  VME  modules  in  an  environment 
suitable  for  ruggedized  use. 


-  Pa  mill'!  Processors  -  5/H8 


Applied  Intelligent  Systems ,  Inc. 


Applied  Intelligent  Systems ,  Inc. 


-  Parallel  Processors  •  5/HH 
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Summary  of  Manipulation  requirements 

“Natural”  Representation  of  signals 

Abstract  data  objects  and  inquiry  operations 

Control  structure  for  sequencing  through  rule 
base 

Representation  of  symbolic  information  (i.e. 
extensivity,  idempotency,  .  .  .)  about  systems. 
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Numbering  of  points  in  the 
elemental  window. 


Elemental  structuring  eleawfit 
are  numbered  By  adding  the 
numbers  for  each  point  which 
is  included. 
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Repetition  factors  denote 
dilating  an  elemental 
structuring  element  By 
a  number  of  time*. 


Arbitrary  structuring  elements 
are  built  from  elemental 
structuring  elements  by 
dilation  and  ^mon. 
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